Energy spectrum visualization system

ABSTRACT

An environmental visualization system is provided for visualization of an energy spectrum. The environmental visualization system may include a front-end system configured to receive input from sensors configured to measure emissions within an environment of a user, and provide a corresponding sensed input that includes a at least one energy frequency of the emissions and that indicates a spatial-temporal distribution of the emissions within the environment. The system may also include an energy spectrum system configured to generate from the sensed input, a multidimensional layout that depicts the at least one energy frequency and spatial-temporal distribution of the emissions from which a significance of the emissions is identifiable, in which the front-end system may be configured to output the multidimensional layout for display by a display device.

TECHNOLOGICAL FIELD

The present disclosure relates generally to interactive environmentalvisualization and, in particular, to energy spectrum visualizationthrough an interface integrated within a user's physical, real-worldenvironment to support engineering activity.

BACKGROUND

Virtual reality is an approach to human-machine interaction andenvironmental visualization in which an “immersive” virtual (or unreal)environment is created to provide a user with the sense of being totallyimmersed in an artificial, three-dimensional (3D) world that isgenerated by computer software. A related, more recent approach tohuman-machine interaction and environmental visualization is augmentedreality in which a view of a user's physical, real-world environment maybe augmented with virtual elements. Virtual reality and augmentedreality are often implemented through the use of display hardware suchas head-mounted systems, computer screens and the like. But pastapproaches to implement virtual and augmented reality through suchdisplay devices have met with varied, but suboptimal success.

For example, in the context of energy emissions, many forms of energyemissions are invisible or otherwise undetectable in meaningful ways forhuman interaction and assessment. As a result, the source of problemsrelated to these emissions may be subsequently difficult to diagnose inreal-time during an event. In particular, the energy emissions may beunrecognized or under evaluated as contributing factors to the relatedproblems, thus leaving the problems unsolved. Exemplary problems relatedto undetected energy emissions may include frequency collisions amongstcomputing devices in an environment (e.g., frequency collisions betweencordless phones in the 2.4 GHz band and microwave signals (particularlypoorly shielded microwaves which can emit signals across the 2.4 GHzband), radio frequency identification (RFID) readers (e.g. UHF,operating in the 860 MHz-960 MHz frequencies) and flight-ready aircraftcomponents having potential energy emissions within an effected energyspectrum such as Auxiliary Power Units (APUs)), detecting andcorrelating physical fatigue (e.g., detecting abhorrent vibrations,frequencies approaching component resonance or harmonics thereof),wireless signal characterization (e.g., investigating areas of weak andstrong signal strength/availability), and the like. Traditionally,adequate investigation of similar types of radiation emissions requiresan array of equipment, and an arduous and lengthy process, as thepresence of radiation itself could not be seen directly, but onlyextrapolated, based on interpretations of an array of gauge readings andpost-processing analysis. The exemplary problems may be more easilyidentified through improved environmental visualization systems.

In another example, within the context of computing architecture, theprocess of troubleshooting within a computing architecture system maygenerally rely on manual evaluations, as a user attempts to understandthe process flow of data through the system. In one instance, anemployee may be required to trace code, monitor network packets, and thelike to ascertain the flow of data throughout a network. As a result,the current methods may be highly cumbersome as there is no way todirectly visualize signals traveling through a network, program, orbetween devices during the troubleshooting process.

Therefore, it may be desirable to have a system and method that improveson existing approaches to environmental visualization.

BRIEF SUMMARY

Example implementations of the present disclosure are directed to animproved system, method and computer-readable storage medium forvisualization of an energy spectrum. The present disclosure includes,without limitation, the following example implementations.

In some example implementations, a method is provided for visualizationof an energy spectrum. The method may comprise receiving input fromsensors configured to measure emissions including electric, magnetic orelectromagnetic fields within an environment of a user. The method mayalso comprise providing a corresponding sensed input that includes atleast one energy frequency of the emissions and that indicates aspatial-temporal distribution of the emissions within the environment.The method may also comprise generating from the sensed input, amultidimensional layout that depicts the at least one energy frequencyand spatial-temporal distribution of the emissions from which asignificance of the emissions is identifiable. The method may alsocomprise receiving and outputting the multidimensional layout fordisplay by a display device.

In some example implementations of the method of the preceding or anysubsequent example implementation, or any combination thereof,outputting the multidimensional layout for display by a display deviceincludes generating or enabling a live or direct view of theenvironment, augmented by the multidimensional layout.

In some example implementations of the method of any preceding or anysubsequent example implementation, or any combination thereof, receivingthe multidimensional layout includes recording in real-time the sensedinput from which the multidimensional layout is generated and therebyproducing a recorded sensed input, and generating from the recordedsensed input, a recorded multidimensional layout. And outputting themultidimensional layout includes outputting the recordedmultidimensional layout for display by the display device to enableplayback of the multidimensional layout in real-time or over apredetermined period of time.

In some example implementations of the method of any preceding or anysubsequent example implementation, or any combination thereof,outputting the recorded multidimensional layout includes generating orenabling a direct view of the environment, augmented by the recordedmultidimensional layout.

In some example implementations of the method of any preceding or anysubsequent example implementation, or any combination thereof, thefields include two or more different types of fields, and generating themultidimensional layout includes generating the multidimensional layoutthat simultaneously includes the two or more different types of fields,and in which each of the two or more different types of fields isrepresented using at least one of a distinct visual, tactile or audibleproperty, the distinct visual, tactile or audible property including atleast one of a color, shape, size, opacity, speed, direction andpulsing.

In some example implementations of the method of any preceding or anysubsequent example implementation, or any combination thereof,generating the multidimensional layout includes receiving a userpreference for the distinct visual, tactile or audible property used torepresent each of the two or more different types of fields.

In some example implementations of the method of any preceding or anysubsequent example implementation, or any combination thereof, themethod further comprises receiving signals communicated and carryingmessages between source and destination network nodes separate anddistinct from the system in a communication network composed of aplurality of network nodes within the environment of the user;generating data input for the signals that indicates the source anddestination network nodes; and generating from the data input, a secondmultidimensional layout that depicts the communication network,including the source and destination network nodes and signalscommunicated therebetween, in which receiving the multidimensionallayout includes further receiving the second multidimensional layout,and outputting the multidimensional layout includes producing from themultidimensional layout and second multidimensional layout a combinedmultidimensional layout that simultaneously depicts the communicationnetwork and the at least one energy frequency and spatial distributionof the emissions, and outputting the combined multidimensional layout.

In some example implementations, an environmental visualization systemis provided. The system may include implementation of subsystems, suchas a front-end system and energy spectrum system, configured to performsteps of the method.

In some example implementations, a computer-readable storage medium isprovided for visualization of an energy spectrum. The computer-readablestorage medium is non-transitory and has computer-readable program codeportions stored therein that, in response to execution by a processor,cause an apparatus to at least perform the method of any precedingexample implementation, or any combination thereof.

These and other features, aspects, and advantages of the presentdisclosure will be apparent from a reading of the following detaileddescription together with the accompanying drawings, which are brieflydescribed below. The present disclosure includes any combination of two,three, four or more features or elements set forth in this disclosure,regardless of whether such features or elements are expressly combinedor otherwise recited in a specific example implementation describedherein. This disclosure is intended to be read holistically such thatany separable features or elements of the disclosure, in any of itsaspects and example implementations, should be viewed as intended,namely to be combinable, unless the context of the disclosure clearlydictates otherwise.

It will therefore be appreciated that this Brief Summary is providedmerely for purposes of summarizing some example implementations so as toprovide a basic understanding of some aspects of the disclosure.Accordingly, it will be appreciated that the above described exampleimplementations are merely examples and should not be construed tonarrow the scope or spirit of the disclosure in any way. Other exampleimplementations, aspects and advantages will become apparent from thefollowing detailed description taken in conjunction with theaccompanying drawings which illustrate, by way of example, theprinciples of some described example implementations.

BRIEF DESCRIPTION OF THE DRAWING(S)

Having thus described example implementations of the disclosure ingeneral terms, reference will now be made to the accompanying drawings,which are not necessarily drawn to scale, and wherein:

FIG. 1 is an illustration of an environmental visualization system inaccordance with an example implementation;

FIG. 2 is an illustration of one example implementation of theenvironmental visualization system in the form of an augmented realitysystem;

FIGS. 3-10 illustrate visualizations rendered by the environmentalvisualization system, in accordance with an example implementation;

FIG. 11 is a flow diagram illustrating various operations of a method ofmaintenance of visualization of an energy spectrum, in accordance withan example implementation;

FIG. 12 is a flow diagram illustrating various operations of a method ofmaintenance of visualization of a computing architecture, in accordancewith an example implementation; and

FIG. 13 illustrates an apparatus according to some exampleimplementations.

DETAILED DESCRIPTION

Some implementations of the present disclosure will now be describedmore fully hereinafter with reference to the accompanying drawings, inwhich some, but not all implementations of the disclosure are shown.Indeed, various implementations of the disclosure may be embodied inmany different forms and should not be construed as limited to theimplementations set forth herein; rather, these example implementationsare provided so that this disclosure will be thorough and complete, andwill fully convey the scope of the disclosure to those skilled in theart. For example, unless otherwise indicated, reference something asbeing a first, second or the like should not be construed to imply aparticular order. Also, something may be described as being abovesomething else (unless otherwise indicated) may instead be below, andvice versa; and similarly, something described as being to the left ofsomething else may instead be to the right, and vice versa. Likereference numerals refer to like elements throughout.

Example implementations of the present disclosure are generally directedto an environmental visualization system for providing a real-timevisualization of non-visible signals within a user's environment.Example implementations will be primarily described in conjunction withenergy spectrum and computing architecture applications. Theenvironmental visualization system may be a more particular example ofthe system described by U.S. patent application Ser. No. 13/903,242,entitled: Ubiquitous Natural User System, filed May 28, 2013, thecontent of which is incorporated by reference in its entirety.

FIG. 1 illustrates an environmental visualization system 100 accordingto example implementations of the present disclosure, which may besimply referred to as the “system” herein. The system may include, forexample, a front-end system 102 connected or otherwise coupled to one ormore interfaces for transmitting, receiving and/or outputtinginformation. The interfaces may include one or more communicationsinterfaces 104, sensors 106 and/or user interfaces. The communicationsinterface may be configured to transmit and/or receive information, suchas to and/or from other elements of the system, one or more resourcehost systems and the like.

The communications interface 104 may be configured to transmit and/orreceive information by physical (wired), and/or wireless communicationslinks such as optical communication links. These wireless communicationlinks in particular may be configured to implement any of a number ofdifferent radio access technologies such as any of a number of 3GPP or4GPP radio access technologies, UMTS UTRA, GSM radio accesstechnologies, CDMA 2000 radio access technologies, WLANs (e.g., IEEE802.xx, e.g., 802.11a, 802.11b, 802.11g, 802.11n), WiMAX, IEEE 802.16,wireless PANs (WPANs) (e.g., IEEE 802.15, Bluetooth®, low power versionsof Bluetooth®, IrDA, UWB, Wibree, Zigbee®), near-field communicationtechnologies, and the like.

The front-end system 102 may also be coupled to one or more sensors 106configured to provide sensed input to the system 100. The sensors, andin some examples the communications interface 104, may generally provideinput necessary for the front-end system to detect and/or recognizesignals, and drive the display of a natural user interface forvisualization of the user's environment. Natural user interfaces mayremove extraneous devices and input modalities, and may allowgeo-temporally and task salient interactions tailored to the role (orclearance level) and purview of the user.

The front-end system 102 may also be coupled to one or more userinterfaces for outputting and/or inputting information, such as adisplay device 108, audio output device(s) such as speaker(s),headphones and the like, haptic sensor(s) configured to provide tactilefeedback such as forces, vibrations or motions. The display device maybe configured to present or otherwise display information to a user, andin some examples may include the display device of a wearable (e.g.,head-mounted) or portable personal display system. Examples of suitablepersonal display systems may include private, private-shared (linkedprivate) or public personal display systems such as those provided inthe form of eyeglasses, safety goggles, contact lenses and the like,image projectors, video projectors, any of a number of other active orpassive display systems, laser pointers and the like. In other examples,the display device may include a more conventional display device suchas a liquid crystal display (LCD), light-emitting diode display (LED),plasma display panel (PDP) and the like, which may or may not take theform of a personal display system (e.g., smartphone, tablet computer).

The user interfaces may also include one or more user input interfaces.These user input interfaces may be wired or wireless, and may beconfigured to receive information from a user into the system 100, suchas for processing, storage and/or display. Suitable examples of userinput interfaces include a microphone, image or video capture device,keyboard or keypad, joystick, touch-sensitive surface (separate from orintegrated into a touchscreen), biometric sensor and the like. Similarto the communications interface, in some examples, a user inputinterface may function as a sensor for providing information directlyfrom a user.

As suggested above, the system 100 of example implementations mayinclude and/or be configured to communicate with one or more resourcehost systems, which may be configured to host electronic resources. Someexamples of host systems may be remote from the system such as acrossone or more networks, while other examples of host systems may be localto the system. The electronic resources may vary depending onapplication of the system, although examples of suitable electronicresources may generally include software-based systems. In someexamples, the resource host system may include an appropriate storageaccessible by an electronic resource, such as file storage, databasestorage, cloud storage and the like. As shown, two examples of suitableresource host systems include an energy spectrum system 110, and acomputing architecture system 112.

The resource host system(s) are shown separate from the system 100, butin various examples, the system may include one or more resource hostsystems. Thus, in some examples, the system may include either or bothof the energy spectrum analysis system 110 or computing architecturesystem 112. Likewise, while the sensors 106 and display device 108 areshown as part of the system, one or more sensors and/or display devicesmay be separate from but in communication with the system, such as inthe case of one or more off-board sensors.

FIG. 2 is an illustration of an environmental visualization system 200(e.g., environment visualization system 100) in the form of an augmentedreality system. As shown, the system may include a computer system 202,which in some examples may be configured to implement the front-endsystem 102 and communication interface 104 of the environmentalvisualization system 100 of FIG. 1. In some examples, the computersystem may comprise, include or be embodied in a portable,hardware-based electronic device such as a smartphone, tablet computerand the like. The computer system may be coupled (by wire or wirelessly)to one or more wearable (e.g., head-mounted) or handheld personaldisplay systems. In some examples, the personal display system may takethe form of augmented reality (AR) eyeglasses, safety goggles, contactlenses and the like (generally AR glasses 204), which may be wearable bya user in an environment. In some examples, the system may be integratedinto the AR glasses.

The computer system 202 and/or AR glasses 204 (or other personal displaysystem) may be equipped with or coupled (by wire or wirelessly) to oneor more sensors (e.g., sensors 106) configured to provide sensed inputto the computer system. As suggested above, for example, the sensors mayinclude an environmental-condition sensor such as a physical fielddetector 226 configured to sense the user's environment and providemeasurements of signals emitted by electronic devices within theenvironment. These measurements may be used for a number of differentpurposes, such as to generate a visualization of the signals within ofthe user's environment.

The sensors may also include one or more cameras 208 that may beconfigured as a user action-tracking sensor and/orenvironmental-condition sensor. The camera(s) may be configured tocapture images or videos of the user and/or their physical, real-worldenvironment; and in some instances, the camera(s) may thereby capturegestures of the user. In some examples, the sensors may include otheruser action-tracking sensors that in some instances may be configured tocapture gestures of the user, according to any of a number of suitablegesture recognition techniques.

The sensors may also include physical field detectors configured tosense signals within the user's environment. Examples of suitablesensors include one or more radiation sensors (e.g., electromagneticfield (EMF) detectors 210, magnetic field sensors 212, electric fieldsensors 214, and the like), transmitters 216, receivers 218, spectrumanalyzers, oscilloscopes, voltage loop sensors, current loops sensors,and the like, Additionally or alternatively, for example, the sensorsmay include an audio sensor such as a microphone 220 configured tocapture audio such as voice commands from the user. In some exampleimplementations, the sensors may vary based upon the environment beingvisualized such that appropriate sensors are utilized for respectiveenvironments. The sensors may be configured to measure voltage (e.g.,frequency and amplitude across time). Examples of suitable sensors mayalso include wiring systems (e.g., building wiring systems, plane wiringsystems, and the like) that monitor reflections (e.g., amplitude andfrequency). In particular, wiring such as that in a building may beutilized as an antenna—used to measure emissions (receiving) or used tocommunicate (transmitting). In some implementations, a differentialreferenced (e.g., building ground) system or conducting ground (e.g.,airplane metal frame) may be utilized.

In the context of computing architecture visualization, the sensors maybe or include networking instrumentation and/or packet informationaccessible via internet protocol (IP) traffic (e.g., TCP/IP and UDP/IP).Such information may be examined through hardware and/or softwareprotocol analyzers (e.g., Wireshark) or directly available within theassociated underlying packet and routing information. For example,correlation of an IP address to a physical system or representation ofthe physical systems (e.g., engineering drawings, maps, and the like maybe determined using IP lookup tables, address management systems and thelike for DNS correlation. IP, DNS and notional reference association(e.g., additional name/reference designators and/or other identifiersassociated with a device or system of devices) may provide a crossreference lookup. In another example, tagging (e.g., part number,fiducial marker, barcode, RFID tag and the like) along with appropriatereading technology (e.g., camera and imaging processing, RIFD reader)may enable identification of assets in field of view to correlate tosensed information.

The sensors may take a number of different forms, and in some examplesmay be user wearable such as on the user's finger, wrist, arm, ankle,leg, waist or torso. In some examples, the AR glasses 204 may beequipped with the 3D scanner 206 and camera(s) 208, which may enable the3D scanner and camera(s) to provide measurements and images/video fromthe user's viewpoint. In some examples, the camera 208 and/or microphone220 may be configured as physiological-condition sensors configured toprovide images/video and/or audio of a user. In some examples, thecomputer system 202 and/or AR glasses 204 may be equipped with orcoupled (by wire or wirelessly) to one or more position sensors 222configured to provide measurements of the position of the user. Asindicated above, examples of suitable position sensors include thosesupporting GPS, inertial navigation, Wi-Fi-based positioning, RFID-basedpositioning or the like.

The AR glasses 204 (or other personal display system) may generate orotherwise enable a live or direct view of the user's environment. The ARglasses may also include a display device 224 (e.g., display device 108)for information from the computer system 202 (e.g., implementing system100), such as information output by electronic resources. In thisregard, the live or direct view of the environment may be augmented byinformation from the computer system. In some examples, the computersystem or AR glasses may further include or be otherwise configured tocommunicate with one or more audio output devices, haptic sensors forproviding audible and/or tactile feedback. This feedback may be providedin addition to or in lieu of certain visual feedback or information bythe display device.

As suggested above and explained below, information from the computersystem 202 may depend on sensed input from one or more sensors 206-222,some of which may be equipped by and others of which may be coupled tothe AR glasses 204 and/or computer system. In one particular example,information from the computer system may vary depending on the viewpointof the user, which may be reflected by sensed input from a sensor suchas the camera 208. In some other examples, the computer system may becoupled to a plurality of AR glasses; and in these examples, informationfrom the computer system may vary for each of the AR glasses dependingon the viewpoints of their respective users.

As discussed herein, energy spectrum visualization may be implementedvia an augmented reality system (e.g., environmental visualizationsystem 200) that includes radiation sensors (e.g., electromagnetic field(EMF) detectors 210, magnetic field sensors 212, electric field sensors214, and the like), a computing device (e.g., computing device 202), anda visualization component (e.g., AR glasses 204, and display device 224)for enabling an end user to physically visualize radiation emissionsoccurring within their environment. Accordingly, the front-end system102 and energy spectrum system 110 may enable a user to visualize avariety of radiation forms (e.g., light, heat, radio waves, and thelike) thereby simplifying the process of troubleshooting radiation-basedissues which may include, but not be limited to, electronics signalinterference, identification of radiation leaks associated withelectronic devices (e.g., microwaves), and/or visualization of radiofrequency collisions in an environment.

In the context of energy spectrum visualization, the front-end system102 may include any of a number of different subsystems (each anindividual system) for performing one or more functions or operations toenable visualization of an energy spectrum within a user's environment.Although not separately described herein, in some examples, thefront-end system may include a number of subsystems, engines and thelike, such as a sensor engine, analysis system, execution system, and/orevaluation system. Further description regarding various suitablesystems, engines and the like may be found in U.S. patent applicationSer. No. 13/903,242, entitled: Ubiquitous Natural User System, filed May28, 2013.

As explained in greater detail below, the front-end system 102 may begenerally configured to receive input from sensors configured to measureemissions. The emissions may include, but not be limited to electric,magnetic and/or electromagnetic fields within an environment of a user.The front-end system may also be generally configured to provide acorresponding sensed input that includes at least one energy frequencyof the emissions and indicates a spatial-temporal distribution of theemissions within the environment. The front-end system may also begenerally configured to provide a corresponding sensed input thatincludes a magnitude and signal type of the emissions. In some exampleimplementations, a direction of the emission may also be detected basedat least in part on the number of sensors, orientation of the sensors,and/or the type of emissions being sensed. The sensors may includecompatible and/or registered sensors or a sensor system for whichautomatic tracking is available for a designated physical space andtime. Accordingly, a user may enable a sensor and/or sensor systemwithin a desired environment, and specify desired spectrums and/orfrequencies for tracking within the designated physical space and time.The front-end system may gather signals (e.g., radiant emissions) fromone or more sensors, and process the sensor signals according torequirement specified by the user.

The energy spectrum system 110 may be coupled to the front-end system102 and generally configured to generate, from the sensed input, amultidimensional layout that depicts the at least one energy frequencyand spatial-temporal distribution of the emissions from which asignificance of the emissions is identifiable. The front-end system maythen output the multidimensional layout for display by a display device108. In addition to a multidimensional layout, the front-end system mayfurther output audio and/or tactile/haptic feedback for presentation bya suitable device such that the environment, and more specifically, theenergy spectrum may be conceptualized through visualization, audio,and/or tactile feedback. The front-end system may enable a user toselect visualization options based on one or more of the signals, signalprocessing capabilities, visualization libraries, and/or visualizationrendering capabilities of a compatible display associated with theenvironmental visualization system 100. As such, the multidimensionallayout may be rendered based at least in part on signal inputs, signalprocessing, and/or user interaction with the system.

In some example implementations, the emissions may include two or moredifferent types of fields. For example, the emissions may include bothan electric and a magnetic field. In such an implementation, the energyspectrum analysis system 110 may be configured to generate amultidimensional layout that simultaneously includes the two or moredifferent types of fields, in which each of the two or more differenttypes of fields is represented using a distinct visual, tactile oraudible property.

Accordingly, a user may visually differentiate, amongst multiplephysical field types and/or intensities as a result of transforming theinvisible radiation associated with the emissions into a variety ofobjects in a visual field. The representative objects may differentiateemissions in a number of ways including, but not limited to differentcolors, color intensity, patterns, opacity or transparency, pulsing ofthe object, size of the object, movement of the object, location ofassociated emissions, trajectory of associated emissions, duration ofassociated emissions, intensity and/or strength of associated emissions,consistency of emissions, and the like.

In such an implementation, the front-end system 102 may be configured toreceive a user preference for the distinct visual, tactile or audibleproperty used to represent each of the two or more different types offields in which the distinct visual, tactile or audible property mayinclude at least one of a color, shape, opacity, pulsing, or otherproperties discussed herein. In some example implementations, pulsingmay be or include a series of pulses as opposed to a recurring frequencyor occurrence of pulses such as a recognizable pattern. The front-endsystem may also be configured to receive a user preference for featuresof interest (e.g., frequency, frequency band, and the like) of aphysical field to be rendered within the display. As such, the emissionsmay be displayed and/or rendered as objects having physicalcharacteristics being determined by the features of interest defined bythe user. In one example, during display, the defined features ofinterest may increase in intensity as they reoccur. Similarly, theexecution system may be configured to receive a user preference to omitfeatures of the physical field from being rendered within the display.

In some example implementations, the fields include at least twointerfering (e.g., collision, anomaly, and the like) fields. In such animplementation, the energy spectrum visualization system 110 may beconfigured to generate a multidimensional visualization layout fromwhich the interference between the at least two fields is identifiable.

As discussed herein, computing architecture visualization may beimplemented via an augmented reality system (e.g., environmentalvisualization system 200) that enables a user to physically visualizeinvisible computing signals representing data as the signals traverseacross and among a communication network including computing systems,networks, and devices. Accordingly, the front-end system 102 mayintegrate multiple visual and interactive troubleshooting processesthereby providing a more intuitive representation of information flowingthroughout the communication network, and reducing cognitive workloadfor the user which in return may reduce the occurrence oftroubleshooting errors and promote a better understanding of the problemat hand.

As explained in greater detail below, the front-end system 102 may begenerally configured to receive signals communicated between source anddestination network nodes. The source and destination network nodes maybe in a communication network composed of a plurality of network nodeswithin an environment of a user in which the source and destinationnodes are separate and distinct from the front-end system. The signalsmay carry messages between the source, intermediate and destinationnetwork nodes. The front-end system may also be generally configured tointerpret the messages to identify the source and destination networknodes, and generate data input for the signals that indicates the sourceand destination network nodes. In some example implementations,receiving the signals may further comprise categorizing the signals toenable the system to more easily and expeditiously interpret of themessages. Accordingly, message may be decoded and/or interpreted inreal-time or during pre-recorded playback of received transmissions.

In some example implementations, the front-end system 102 may beconfigured to receive the signals from a source network node or adestination network node as they are being communicated between thesource, an intermediate point and/or destination. In at least oneinstance the signals may be communicated between the source anddestination network nodes over a wired or physical medium (e.g., copperwire, optical fiber, coaxial cable, and the like) or in the form ofwireless transmission or electromagnetic wave.

The computing architecture system 112 may be coupled to the front-endsystem 102 and generally configured to generate from the data input, amultidimensional layout that depicts the communication network.Accordingly, the multidimensional layout may include the source anddestination network nodes and signals communicated between the sourceand destination network nodes. The front-end system 102 may then outputthe multidimensional layout for display by a display device 110.Accordingly, the display device may enable physical projection of acomputing architecture onto a map, diagram, schematic, and/or within theenvironment of a user in real-time or asynchronously. The projection mayprovide a first person view of signal traversal through or across thecommunication network. The multidimensional layout may be overlaid on atleast one (but potentially more than one, simultaneously) of thefollowing including, but not limited to directly within the users fieldof view, a two dimensional representation (e.g., engineering drawing,map, and the like), a three dimensional representation (e.g., a to-scalemodel), a four dimensional representation including time (e.g., the lasttwenty Fridays at this time)

In some example implementations, the signals include two or morecharacteristics. In such an implementation, the computing architecturesystem 112 may be configured to generate a multidimensional layout thatsimultaneously depicts the two or more characteristics in which each ofthe two or more characteristics is represented using the distinctvisual, tactile or audible property. Accordingly, a user may visuallydifferentiate, amongst multiple signal characteristics by transformingthe characteristics associated with the signals into a variety ofobjects in a visual field. The representative objects may differentiatecharacteristics in a number of ways including, but not limited todifferent colors, color intensity, patterns, opacity or transparency,pulsing of the object, size of the object, movement of the object,location of signals, trajectory of signals, duration of signals,intensity and/or strength of signals, consistency of signals,destination of signals, and the like.

This feature may enable a user to visualize information at a conceptuallevel (e.g., objects with shape, color, texture, opacity, frequency ofpulsing, and the like) as opposed to electrical frequency until the useridentifies specific areas of interest (e.g., an anomaly) such that theuser may select those representations (e.g., audio/visual/tactile),pause the representations (e.g., stop the streaming of information whilestill recording) and examine details of the selected information objector objects (e.g., view envelope and payload details of a TCP/IP packetbased on the selected object(s), or examine the emitted frequenciesemitted by a computing, storage or transmission device, applyappropriate algorithms for the purpose of decoding a transmission, andthe like)

In such an implementation, the front-end system 102 may be configured toreceive a user preference for the distinct visual, tactile or audibleproperty used to represent each of the two or more different types ofcharacteristics. The two or more characteristics may include at leasttwo of a signal characteristic (e.g., raw wave forms), transmissioncharacteristic (e.g., data packet information), or content (e.g.,payload content, actual message) associated with the signalscommunicated between the source and destination network nodes.

The front-end system 102 may also be configured to receive a userpreference for characteristics of interest (e.g., signal characteristic,transmission characteristics, and the like) of a signal to be renderedwithin the display. As such, the signals may be displayed and/orrendered as objects having physical characteristics being determined bythe characteristics of interest defined by the user. Similarly, thefront-end system may be configured to receive a user preference to omitcharacteristics of the signal from being rendered within the display.

In some example implementations, the front-end system 102 may beconfigured to receive a user input setting a trigger to detect aparticular event and/or signal, and thereby capture the event upondetection of the trigger. The front-end system may also trigger aworkflow of the detected event based on the characteristics of theevent. The front-end system may further enable tagging forcharacteristics of interest to be traced throughout the communicationnetwork.

In some example implementations, the computing architecture system 112may be configured to generate a multidimensional layout including adepiction of the communication network that indicates a distribution ofthe network nodes including the source and destination network nodes. Insome example implementations, the distribution may be a spatial orfunctional distribution.

In some example implementations, the energy spectrum system 110 maygenerate a first multidimensional layout that depicts the at least oneenergy frequency and spatial-temporal distribution of the emissions fromwhich a significance of the emissions is identifiable, and the computingarchitecture system 112 may generate a second multidimensional layoutthat depicts the communication network, including the source anddestination network nodes and signals communicated therebetween. In suchan implementation, the front-end system 102 may be configured to receivethe first and second multidimensional layouts and product from the firstand second multidimensional layouts a combined multidimensional layoutthat simultaneously depicts the communication network and the at leastone energy frequency and spatial-temporal distribution of the emissions,and outputting the combined multidimensional layout. The combinedmultidimensional layout may then be output by the front-end system fordisplay by a display device.

In some example implementations, the display device 110 may beconfigured to generate and/or enable a live or direct view of theenvironment, augmented by the multidimensional layout. Themultidimensional layout may be overlaid on at least one (but potentiallymore than one, simultaneously) of the following including, but notlimited to, directly within the users field of view, a two dimensionalrepresentation (e.g., engineering drawing, map, and the like), or athree dimensional representation (e.g., a to-scale model).

In some example implementations, the front-end system 102 may beconfigured to record in real-time the input (e.g., sensed input, datainput, and the like) from which the multidimensional layout is generatedand thereby produce a recorded input, and from the recording inputgenerate a recorded multidimensional layout in which the recordedmultidimensional layout may be output for display by the display device110 to enable playback (e.g., pause, slow motion, fast forward, reverseand the like) of the multidimensional layout in real-time or over apredetermined period of time as defined by the user. As such, this mayenable slowing down in real-time or pausing a real-time display to bothinteract as the information occurs as well as to go back and visualizewhat was previously displayed. Additionally, the user may be enabled toview the presented sensed signals from different perspectives (both fromchanging the viewing angle within the environment as well as the formrendered—e.g., look from the emissions visualized directly in theenvironment to the engineering drawing on paper or on a tablet computer,for example).

The front-end system 102 may record underlying signals and optionallythe user interaction within the environment. In some implementationsmultiple instances of recorded multidimensional layouts may be replayedsimultaneously such that a user is able to visualize discrepanciesacross different snapshots of time. Playback may occur over apredetermined period of time, but may often be utilized to pause inreal-time and/or rewind to examine signals recently detected in moredetail which, in some instance may likely strip and/or remove thedisplay of other signals from the presentation modalities. Playback mayoccur for prior recorded signals that have received seconds, minutes,hours, weeks, and/or years in the past.

Prior signals may be simultaneously played back while viewing currentlysensed signals. The playback may include multiple recordings (e.g.,replay yesterday at a specific period of time, or replay every Mondayfor the last three weeks at a specific period of time) along with thecurrently sensed signals being displayed—or in absence of the currentlysensed signals being displayed. As such, individual signals may befurther selected for examination or to be suppressed from the playbackinterface.

In such an implementation, the display device 110 may be configured togenerate or enable a direct view of the environment, augmented by therecorded multidimensional layout. As such, the user may be enabled tovisualize the multidimensional layout in a three dimensional (3D) spacesto better understand the nature of the signals (e.g., radiantemissions). For example, a user may have the ability to walk around agiven recorded instance being physically indexed to the location thatthe recording was initially captures. In an alternative implementation,a recorded multidimensional layout may be presented independent of theindexed environment such that a user is able to view the originallycaptured multidimensional layout from different aspects.

In some example implementations, the front-end system 102 may enable auser to physically select a signal and/or physical field via gesture(e.g., tap and zoom) to view details of the data associated with thesignal and/or physical field.

In some example implementations, the front-end system 102 may beconfigured to output the multidimensional layout for display by aplurality of display devices of a respective plurality of users. Forexample, a multidimensional layout can be simultaneously reviewed bymultiple users at remote locations from the same vantage point, or fromseparate, independent and disparate vantage points.

The environmental visualization system 100 and methods of exampleimplementations may find use in a variety of potential applications,such as in the context of a complex system such as an aircraft or any ofa number of other structures. One example of a suitable application isthe support of engineering activities such as those performed duringpre-production, production or post-production of a complex system suchas an aircraft. Another example of a suitable application is the supportof tasks such as pre-production, production or post-production tasksperformed on components of a complex system. Examples are describedbelow in the context of the implementation of the system shown anddescribed with reference to FIG. 2, namely, in the form of the system200. It should be understood, however, that the scenarios are equallyapplicable to other more general or more specific implementations of thesystem, including those with other types of personal display systems.

In one example implementation, the environmental visualization system100, and more particularly the front-end system 102 and energy spectrumsystem 110, may be utilized to identify frequency interferences. Forexample, as illustrated in FIG. 3, in a factory environment 300 or on aflight line during commercial aircraft manufacture, informationgathering devices 302 for measuring and/or acquiring part informationover a radio frequency spectrum may be utilized. Examples of suitableinformation gathering devices may include RFID readers/writers. Forexample, the RFID reader may be configured to gather information fromserialized parts of an aircraft. In instances in which an assembledairplane 304 is powered via power generated by a source 306 other thanthe engine (e.g., a ground power unit (GPU), or other auxiliary powerunit (APU)), a potential exists for the occurrence of noise 308 withassociated the external power source (e.g., motor-generator sets) ofsuch systems. The external power source may inject frequencies outsideof the power generation frequencies (e.g., 60 Hz, 400 Hz, and the like).When such external electrical (e.g., power bus) and electromagneticnoise is introduced into the environment, the interference may degradeor inhibit operations of equipment designed for manufacture,maintenance, and the like. The front-end system may be utilized toidentify such interferences by providing visualization of energyspectrum components present in the areas of operation, and by providingquick and meaningful insight to equipment operators.

As illustrated in FIGS. 4 and 5, in another example implementation, theenvironmental visualization system 100, and more particularly thefront-end system 102 and energy spectrum system 110, may be utilized toidentify frequency interferences in the context of factory operations.For example, a computer 402 may be utilized to perform end-of-linefunctional test on a microcontroller 404 used in a manufacturedindustrial product 406. Communication between the computer andmicrocontroller may occur via power line modems 408, 410 superimposinghigh frequency signals 412 on a building power system's carrierfrequency (60 Hz). As shown in FIG. 4 for a factory environment 400, thecommunication may function as expected during normal operations.However, as illustrated in FIG. 5, sporadic use of electrically noisyequipment 414 (e.g., TIG welders) within a factory environment 500 mayintroduce high frequency signals 416 on the building's power lines.Typically having little to no impact on 60 Hz equipment, specializedpower line modems 408, 410 may be highly sensitive to signals in theirspectrum of operation. The front-end system may be utilized to provide avisual display of the interference to enable an operator to visualize acorrelation related to the problem thereby resulting in a rapid analysisof the root cause of the related issue.

In another example implementation, the environmental visualizationsystem 100, and more particularly the front-end system 102 including thefront-end system and networking engine, may be utilized in conjunctionto identify interferences and assist in rapid problem resolution forsoftware and/or network related problems. For example, upon inspectionof the energy spectrum “noise”, emissions may be detected as interferingwith communication and/or having a negative effect on the performance ofa computing system. This determination may be based on various factorsincluding but not limited to frequency, rate, and brute force decodingapproaches. In some examples, interferences may be associated withintentional power line communication, and in other examples power linecommunication may be unintentional—either through tacitly embeddedsystems or by leveraging power lines as a basic antenna.

In one example implementation, the environmental visualization system100, and more particularly the front-end system 102 computingarchitecture system 112, may be utilized for debugging networkedcomputing applications. For example, the front-end system may enabledebugging task (e.g., generating text documents representative of datapackets captured based on protocol, port and other filter patternsapplied, deciphering filtered results, correlating results with thedevice(s) applications based on IP tables, port and protocolassociations, and the like) to be relegated to computational processesand visually displayed as a virtual connection between physical devicesusing an overlay visualization apparatus (e.g., projector, head mountdisplay, and the like). User interaction with relation to the virtualconnection may be detected and correlated to action specific tasks. Forexample, as illustrated in FIG. 6, a user 602 may physically “touch” thevirtual connection stream 600 such that the front-end system invokes adisplay 604 for the underlying packet information being filtered basedon preference and user selection and/or communication between one ormore nodes of the intermediate path if known. The virtual connectionstream 600 may represent communication between one or more source anddestination nodes, and an associated intermediate path, if known.

In an alternative example, as illustrated in FIG. 7, informationalrepresentation for the virtual connection 700 includes the use of threedimensional (3D) shapes 702. The size of the shapes, speed of traversalbetween source and destination nodes, color, hue, opacity, intensity,persistence (e.g., solid to rapid flashing), and the like may becorrelated to information-specific attributes. In some implementations,for example, the user 704 may select to correlate data packet payloadsize to object size, color to computing device (e.g., a color associatedwith an internet protocol (IP) address), and shape to represent aprotocol-port combination. In an alternative example, the object shapemay represent a computing device, the object color may represent port,and the object rotation may represent a protocol.

It should be noted that a physical existence of a computing device isnot necessary for the interactive display. For example, as illustratedin FIG. 8, printed schematics 800 of physical systems (e.g., usingcorrelated cues such as markers, image recognition, text recognition,and the like) may be registered to display the physical interactions802. The system may be configured to provide a scrollable virtualtimeline 804 for controlling playback of an interactive display in whichone or more playback controls 806 may also be provided.

In one example implementation, as illustrated in FIG. 9, the front-endsystem 102 may enable either playback or real time connectioninformation represented by directional, linear flow information within aschematic 900 (e.g., engineering drawing) in which the dwell of flow maybe configurable. For example, the dwell of flow may be set to graduallydiminish in intensity (similar to an oscilloscope) over a period oftime. In one implementation, the dwell of flow may diminish to no morethan fifty percent (50%) of the frequency of the signal. The user mayalso be presented a virtual menu 902 for configuring the display and/oranalysis features. In another example implementation, as illustrated inFIG. 10, other representations such as a geographical representation1000 (e.g., map, globe, miniature/model representation, and the like)may be utilized for visualization of a respective computingarchitecture. The system may also be configured to provide a virtualzoom feature 1002 for controlling the projected multidimensional output.

FIG. 11 illustrates a flowchart including various operations of a method1100 for visualization of an energy spectrum, in accordance with anexample implementation of the present disclosure. As shown at block1102, the method may include receiving input from sensors configured tomeasure emissions including electric, magnetic or electromagnetic fieldswithin an environment of a user. The method may include providing acorresponding sensed input that includes at least one energy frequencyof the emissions and that indicates a spatial distribution of theemissions within the environment, as shown in block 1104. The method mayalso include generating from the sensed input, a multidimensional layoutof the at least one energy frequency and spatial distribution of theemissions from which a significance of the emissions is identifiable, asshown at block 1106. The method may also include outputting themultidimensional layout for display by a front-end system, as shown inblock 1108.

FIG. 12 illustrates a flowchart including various operations of a method1200 for implementation of a front-end system for visualization of acomputing architecture, in accordance with an example implementation ofthe present disclosure. As shown at block 1202, the method may includereceiving signals communicated between source and destination networknodes separate and distinct from the apparatus in a communicationnetwork composed of a plurality of network nodes within an environmentof a user in which the signals carry messages between the source anddestination network nodes. The method may include interpreting themessages to identify the source and destination network nodes for thesignals, as shown at block 1204. The method may include generating datainput for the signals that indicates the source and destination networknodes, as shown in block 1206. The method may also include generatinggenerate from the data input, a multidimensional layout that depicts thecommunication network, including the source and destination networknodes and signals communicated therebetween, as shown at block 1208. Themethod may also include outputting the multidimensional layout fordisplay by a front-end system, as shown in block 1210.

According to example implementations of the present disclosure, theenvironmental visualization system 100 and resource host systems (e.g.,energy spectrum system 110, computing architecture system 112), andtheir respective subsystems may be implemented by various means.Similarly, the example system 200, including each of its respectivesubsystems, elements and the like, may be implemented by various meansaccording to example implementations. Means for implementing thesystems, subsystems and their respective elements may include hardware,alone or under direction of one or more computer programs from acomputer-readable storage medium.

In some examples, one or more apparatuses may be provided that areconfigured to function as or otherwise implement the systems,subsystems, tools and respective elements shown and described herein. Inexamples involving more than one apparatus, the respective apparatusesmay be connected to or otherwise in communication with one another in anumber of different manners, such as directly or indirectly via a wiredor wireless network or the like.

FIG. 13 illustrates an apparatus 1300 according to some exampleimplementations of the present disclosure. Generally, an apparatus ofexample implementations of the present disclosure may comprise, includeor be embodied in one or more fixed or portable electronic devices.Examples of suitable electronic devices include a smartphone, tabletcomputer, laptop computer, desktop computer, workstation computer,server computer or the like. The apparatus may include one or more ofeach of a number of components such as, for example, a processor 1302(e.g., processor unit) connected to a memory 1304 (e.g., storagedevice).

The processor 1302 is generally any piece of computer hardware that iscapable of processing information such as, for example, data, computerprograms and/or other suitable electronic information. The processor iscomposed of a collection of electronic circuits some of which may bepackaged as an integrated circuit or multiple interconnected integratedcircuits (an integrated circuit at times more commonly referred to as a“chip”). The processor may be configured to execute computer programs,which may be stored onboard the processor or otherwise stored in thememory 1304 (of the same or another apparatus).

The processor 1302 may be a number of processors, a multi-processor coreor some other type of processor, depending on the particularimplementation. Further, the processor may be implemented using a numberof heterogeneous processor systems in which a main processor is presentwith one or more secondary processors on a single chip. As anotherillustrative example, the processor may be a symmetric multi-processorsystem containing multiple processors of the same type. In yet anotherexample, the processor may be embodied as or otherwise include one ormore application-specific integrated circuits (ASICs),field-programmable gate arrays (FPGAs) or the like. Thus, although theprocessor may be capable of executing a computer program to perform oneor more functions, the processor of various examples may be capable ofperforming one or more functions without the aid of a computer program.

The memory 1304 is generally any piece of computer hardware that iscapable of storing information such as, for example, data, computerprograms (e.g., computer-readable program code 1306) and/or othersuitable information either on a temporary basis and/or a permanentbasis. The memory may include volatile and/or non-volatile memory, andmay be fixed or removable. Examples of suitable memory include randomaccess memory (RAM), read-only memory (ROM), a hard drive, a flashmemory, a thumb drive, a removable computer diskette, an optical disk, amagnetic tape or some combination of the above. Optical disks mayinclude compact disk-read only memory (CD-ROM), compact disk-read/write(CD-R/W), DVD or the like. In various instances, the memory may bereferred to as a computer-readable storage medium. The computer-readablestorage medium is a non-transitory device capable of storinginformation, and is distinguishable from computer-readable transmissionmedia such as electronic transitory signals capable of carryinginformation from one location to another. Computer-readable medium asdescribed herein may generally refer to a computer-readable storagemedium or computer-readable transmission medium.

In addition to the memory, the processor may also be connected to one ormore interfaces for displaying, transmitting and/or receivinginformation. The interfaces may include one or more communicationinterfaces 1308 (e.g., communications interfaces 104), sensors 106(e.g., sensors 206-220) and/or user input interfaces 1312, examples ofwhich are described above with reference to communications interface104, sensor 106 and/or user interface (including display device108—e.g., display device 224).

As indicated above, program code instructions may be stored in memory,and executed by a processor, to implement functions of the systems,subsystems and their respective elements described herein. As will beappreciated, any suitable program code instructions may be loaded onto acomputer or other programmable apparatus from a computer-readablestorage medium to produce a particular machine, such that the particularmachine becomes a means for implementing the functions specified herein.These program code instructions may also be stored in acomputer-readable storage medium that can direct a computer, a processoror other programmable apparatus to function in a particular manner tothereby generate a particular machine or particular article ofmanufacture. The instructions stored in the computer-readable storagemedium may produce an article of manufacture, where the article ofmanufacture becomes a means for implementing functions described herein.The program code instructions may be retrieved from a computer-readablestorage medium and loaded into a computer, processor or otherprogrammable apparatus to configure the computer, processor or otherprogrammable apparatus to execute operations to be performed on or bythe computer, processor or other programmable apparatus.

Retrieval, loading and execution of the program code instructions may beperformed sequentially such that one instruction is retrieved, loadedand executed at a time. In some example implementations, retrieval,loading and/or execution may be performed in parallel such that multipleinstructions are retrieved, loaded, and/or executed together. Executionof the program code instructions may produce a computer-implementedprocess such that the instructions executed by the computer, processoror other programmable apparatus provide operations for implementingfunctions described herein.

Execution of instructions by a processor, or storage of instructions ina computer-readable storage medium, supports combinations of operationsfor performing the specified functions. In this manner, an apparatus1300 may include a processor 1302 and a computer-readable storage mediumor memory 1304 coupled to the processor, where the processor isconfigured to execute computer-readable program code 1306 stored in thememory. It will also be understood that one or more functions, andcombinations of functions, may be implemented by special purposehardware-based computer systems and/or processors which perform thespecified functions, or combinations of special purpose hardware andprogram code instructions.

Many modifications and other implementations of the disclosure set forthherein will come to mind to one skilled in the art to which thedisclosure pertains having the benefit of the teachings presented in theforegoing description and the associated drawings. Therefore, it is tobe understood that the disclosure is not to be limited to the specificimplementations disclosed and that modifications and otherimplementations are intended to be included within the scope of theappended claims. Moreover, although the foregoing description and theassociated drawings describe example implementations in the context ofcertain example combinations of elements and/or functions, it should beappreciated that different combinations of elements and/or functions maybe provided by alternative implementations without departing from thescope of the appended claims. In this regard, for example, differentcombinations of elements and/or functions than those explicitlydescribed above are also contemplated as may be set forth in some of theappended claims. Although specific terms are employed herein, they areused in a generic and descriptive sense only and not for purposes oflimitation.

What is claimed is:
 1. An environmental visualization system comprising:a front-end system configured to receive input from sensors configuredto measure emissions including electric, magnetic or electromagneticfields within an environment of a user, the front-end system beingconfigured to provide a corresponding sensed input that includes atleast one energy frequency of the emissions and that indicates aspatial-temporal distribution of the emissions within the environment;and an energy spectrum system coupled to the front-end system andconfigured to generate from the sensed input, a multidimensional layoutthat depicts the at least one energy frequency and spatial-temporaldistribution of the emissions from which a significance of the emissionsis identifiable, wherein the front-end system is configured to receiveand output the multidimensional layout for display by a display device.2. The system of claim 1, wherein the front-end system being configuredto output the multidimensional layout for display by a display deviceincludes the display device being configured to generate or enable alive or direct view of the environment, augmented by themultidimensional layout.
 3. The system of claim 1, wherein the front-endsystem being configured to receive the multidimensional layout includesbeing configured to record in real-time the sensed input from which themultidimensional layout is generated and thereby produce a recordedsensed input, and generate from the recorded sensed input, a recordedmultidimensional layout, and the front-end system being configured tooutput the multidimensional layout includes being configured to outputthe recorded multidimensional layout for display by the display deviceto enable playback of the multidimensional layout in real-time or over apredetermined period of time.
 4. The system of claim 3, wherein thefront-end system being configured to output the recordedmultidimensional layout includes the display device being configured togenerate or enable a direct view of the environment, augmented by therecorded multidimensional layout.
 5. The system of claim 1, wherein thefields include two or more different types of fields, and the energyspectrum system being configured to generate the multidimensional layoutincludes being configured to generate the multidimensional layout thatsimultaneously includes the two or more different types of fields, andin which each of the two or more different types of fields isrepresented using at least one of a distinct visual, tactile or audibleproperty, the distinct visual, tactile or audible property including atleast one of a color, shape, size, opacity, speed, direction andpulsing.
 6. The system of claim 5, wherein the energy spectrum systembeing configured to generate the multidimensional layout includes beingconfigured to receive a user preference for the distinct visual, tactileor audible property used to represent each of the two or more differenttypes of fields.
 7. The system of claim 1, wherein the front-end systemis further configured to receive signals communicated and carryingmessages between source and destination network nodes separate anddistinct from the system in a communication network composed of aplurality of network nodes within the environment of the user, andgenerate data input for the signals that indicates the source anddestination network nodes, wherein the system further comprises acomputing architecture system configured to generate from the datainput, a second multidimensional layout that depicts the communicationnetwork, including the source and destination network nodes and signalscommunicated therebetween, and wherein the front-end system beingconfigured to receive the multidimensional layout includes beingconfigured to further receive the second multidimensional layout, andthe front-end system being configured to output the multidimensionallayout includes being configured to produce from the multidimensionallayout and second multidimensional layout, a combined multidimensionallayout that simultaneously depicts the communication network and the atleast one energy frequency and spatial distribution of the emissions,and output the combined multidimensional layout.
 8. A method forvisualization of an energy spectrum, the method comprising: receivinginput from sensors configured to measure emissions including electric,magnetic or electromagnetic fields within an environment of a user;providing a corresponding sensed input that includes at least one energyfrequency of the emissions and that indicates a spatial-temporaldistribution of the emissions within the environment; generating fromthe sensed input, a multidimensional layout that depicts the at leastone energy frequency and spatial-temporal distribution of the emissionsfrom which a significance of the emissions is identifiable; andreceiving and outputting the multidimensional layout for display by adisplay device.
 9. The method of claim 8, wherein outputting themultidimensional layout for display by a display device includesgenerating or enabling a live or direct view of the environment,augmented by the multidimensional layout.
 10. The method of claim 8,wherein receiving the multidimensional layout includes recording inreal-time the sensed input from which the multidimensional layout isgenerated and thereby producing a recorded sensed input, and generatingfrom the recorded sensed input, a recorded multidimensional layout, andwherein outputting the multidimensional layout includes outputting therecorded multidimensional layout for display by the display device toenable playback of the multidimensional layout in real-time or over apredetermined period of time.
 11. The method of claim 10, whereinoutputting the recorded multidimensional layout includes generating orenabling a direct view of the environment, augmented by the recordedmultidimensional layout.
 12. The method of claim 8, wherein the fieldsinclude two or more different types of fields, and generating themultidimensional layout includes generating the multidimensional layoutthat simultaneously includes the two or more different types of fields,and in which each of the two or more different types of fields isrepresented using at least one of a distinct visual, tactile or audibleproperty, the distinct visual, tactile or audible property including atleast one of a color, shape, size, opacity, speed, direction andpulsing.
 13. The method of claim 12, wherein generating themultidimensional layout includes receiving a user preference for thedistinct visual, tactile or audible property used to represent each ofthe two or more different types of fields.
 14. The method of claim 8,the method further comprising: receiving signals communicated andcarrying messages between source and destination network nodes separateand distinct from the system in a communication network composed of aplurality of network nodes within the environment of the user;generating data input for the signals that indicates the source anddestination network nodes; generating from the data input, a secondmultidimensional layout that depicts the communication network,including the source and destination network nodes and signalscommunicated therebetween, wherein receiving the multidimensional layoutincludes further receiving the second multidimensional layout, andwherein outputting the multidimensional layout includes producing fromthe multidimensional layout and the second multidimensional layout, acombined multidimensional layout that simultaneously depicts thecommunication network and the at least one energy frequency and spatialdistribution of the emissions, and outputting the combinedmultidimensional layout.
 15. A computer-readable storage medium havingcomputer-readable program code stored therein for visualization of anenergy spectrum, which in response to execution by a processor, cause anapparatus to at least: receive input from sensors configured to measureemissions including electric, magnetic or electromagnetic fields withinan environment of a user; provide a corresponding sensed input thatincludes at least one energy frequency of the emissions and thatindicates a spatial-temporal distribution of the emissions within theenvironment; generate from the sensed input, a multidimensional layoutthat depicts the at least one energy frequency and spatial-temporaldistribution of the emissions from which a significance of the emissionsis identifiable; and receive and output the multidimensional layout fordisplay by a display device.
 16. The computer-readable storage medium ofclaim 15, wherein the apparatus being caused to output themultidimensional layout for display by a display device includes beingcaused to generate or enable a live or direct view of the environment,augmented by the multidimensional layout.
 17. The computer-readablestorage medium of claim 1, wherein the apparatus being caused to receivethe multidimensional layout includes being caused to record in real-timethe sensed input from which the multidimensional layout is generated andthereby produce a recorded sensed input, and generate from the recordedsensed input, a recorded multidimensional layout, and the apparatusbeing caused to output the multidimensional layout includes being causedto output the recorded multidimensional layout for display by thedisplay device to enable playback of the multidimensional layout inreal-time or over a predetermined period of time.
 18. Thecomputer-readable storage medium of claim 17, wherein the apparatusbeing caused to output the recorded multidimensional layout includesbeing caused to generate or enable a direct view of the environment,augmented by the recorded multidimensional layout.
 19. Thecomputer-readable storage medium of claim 15, wherein the fields includetwo or more different types of fields, and the apparatus being caused togenerate the multidimensional layout includes being caused to generatethe multidimensional layout that simultaneously includes the two or moredifferent types of fields, and in which each of the two or moredifferent types of fields is represented using at least one of adistinct visual, tactile or audible property, the distinct visual,tactile or audible property including at least one of a color, shape,size, opacity, speed, direction and pulsing.
 20. The computer-readablestorage medium of claim 15, wherein the apparatus being caused togenerate the multidimensional layout includes being caused to receive auser preference for the distinct visual, tactile or audible propertyused to represent each of the two or more different types of fields. 21.The computer-readable storage medium of claim 15, the apparatus beingfurther caused to: receive signals communicated and carrying messagesbetween source and destination network nodes separate and distinct fromthe system in a communication network composed of a plurality of networknodes within the environment of the user; generate data input for thesignals that indicates the source and destination network nodes;generate from the data input, a second multidimensional layout thatdepicts the communication network, including the source and destinationnetwork nodes and signals communicated therebetween, wherein theapparatus being caused to receive the multidimensional layout includesbeing caused to further receive the second multidimensional layout, andthe apparatus being caused to output the multidimensional layoutincludes being caused to produce from the multidimensional layout andthe second multidimensional layout, a combined multidimensional layoutthat simultaneously depicts the communication network and the at leastone energy frequency and spatial distribution of the emissions, andoutput the combined multidimensional layout.